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ABSTRACT 

Examining student reactions to teachers* comments on 
themes, this study aimed to determine the effects of various 
combinations of reinforcement upon three dependent variables: (1) 
student perception of comments as positive or negative, (2) student 
satisfaction with comments, and (3) student confidence in writing 
ability. Six intermediate and advanced English classes (141 eleventh 
grade students in all) were divided randomly into nine treatment 
groups. Two cooperating teachers assigned an argumentative essay, due 
in 4 days, which then received one of nine comment 
treatments — composed by the experimenter— but no letter grade. 
Students were allowed 5 minutes to read these comments before the 
essays were collected and questionnaires were distributed to be 
filled out at leisure. Results showed that (1) the number of comments 
produced little effect; (2) purely negative comments produced lower 
scores in reinforcement, satisfaction, and confidence than completely 
positive comments produced; and (3) a mixture of criticism and 
praise, with praise dominating, produced the most satisfied and 
confident writers. (The writing assignment and questionnaire are 
appended.) (JM) 



EDO 39241 



U.S. DEPARTMENT OF HEALTH. EDUCATION t WELFARE 
OffICE Or EDUCATION 



THIS DOCUMENT HAS BEEN REPRODUCED EXACTLY AS RECEIVED FROM THE 
PERSON OR ORGANIZATION ORIGINATING IT. POINTS Of VIEW OR OPINIONS 
STATED DO NOT NECESSARILY REPRESENT OFFICIAL OFFICE OF EDUCATION 
POSITION OR POLICY. 



THE UNIVERSITY OP CHICAGO 
THE GRADUATE SCHOOL OP EDUCATION 



INTERPRETING THE PENCILED SCRAWL: 
A PROBLEM IN TEACHER 



TB 



EVALUATION 



A PAPER SUBMITTED IN PARTIAL FULFILLMENT 
OF THE REQUIREMENTS FOR THE DEGREE OF 
MASTER OF ARTS IN TEACHING 



BY 

GRACE ALLISON CLARKE 



C 

<0 

OO 

0 

0 

to 

h 

ERiC 



CHICAGO, ILLINOIS 
MAT, 1969 




I INTRODUCTION 



In 1924, Rollo Lyman had little praise for the comments 
written by teachers on student themes. He condemned typical 
methods of appraisal as mechanical and blamed them for making 
students hate to write. ”The English composition class, 11 he 
noted, ”works too often under the unhealthy psychosis of fear 
and disgust when carrying through a written assignment.” 1 Twen- 
ty-five years later, S. I. Hayakawa had the same complaint* 

Most freshman themes are written ... in the knowledge 
that the incidental and even unconscious mechanics of the 
communicative act are going to he much more closely attend- 
ed to than content. No wonder then, that the average 
freshman writes uneasily and self-consciously. 2 

The idea that written teacher comments can cause student 
frustration and discouragement is not new. Unfortunately, age 
does not guarantee an idea adequate analysis and validation. 

As late as 1963, Henry Meckel could write, ”There appear . . . 
to have been no actual investigations of student attitudes and 
responses to teacher comments on papers.”^ 

The aim of this study is to discover possible determi- 
nants of student attitudes toward written teacher comments. An 
underlying assumption is that encouragement and confidence 
constitute a better atmosphere for writing than ”fear and dis- 
gust.” 
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II REVIEW OF RESEARCH 



Deficiencies of Existing Studies 

There is no prior research on the question of student 
attitudes toward teacher comments themselves. Of the few 
studies examining the effect of written teacher comments on 
students, most deal solely with the effect of comments on per- 
formance. Only two studies consider both performance and, in 
addition, attitudes toward writing or English class. 

It is most efficient to build on existing knowledge, and 
previous research on teacher comments could have proved helpful 
in constructing a research design for the present study. For 

■i I 

example, before measuring student attitudes toward comments, 
one must identify the variables to which students might react* 

Any of the existing studies could be expected to include analy- 
sis of the variables differentiating one comment from another. 

Unfortunately, most of the existing research is weakest 
in its analysis of variables. Relevant variables are often 
either unidentified or unclear ly defined. The comment treat- 
ments studied by one researcher often differ radically and unsys- 
tematically from those studied by another. As a result, a tally 
of which research supports or rejects a particular type of comment 
is impossible. To make matters worse, the factor of correction 
or revision is an important— if disguised— variable In numerous 

instances. The most existing studies can do is indicate, by 
their deficiencies, questions which might be raised with profit. 
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Burton and Arnold (1963) 

In The Effects of Prequency of Writing ?nd Intensity of 
Teacher Evaluation Upon High School Students 1 Performance In 
Written Composition * Dwight Burton and Lois Arnold study the 
effect of two kinds of written teacher evaluation, moderate and 
Intensive* Unfortunately, the authors 1 description of these in- 
dependent variables is sufficiently vague and contradictory to 
make one suspect that the comment treatments were not uniform* 
According to the operational definition, moderate evaluation is 
"that kind of marking in which the teacher selects only an occa- 
sional paper to grade or corrects only those errors pertaining 
to skills which the students are studying at a particular time*"^ 
In the "Description of Treatments," however, one reads that mod- 
erate evaluation "concentrated one time on sentence structure, 

t ,5 

another on logic or organization." One is left wondering whether 
or not all papers written by the moderate evaluation group received 
comment* 

A similar problem of variable Identification arises con- 
cerning the intensive evaluation groups* According to the op- 
erational definition, "intensive evaluation involves the marking 
of every error and the writing of detailed comments on each com- 
position*"^ The "Description of Treatments," however, suggests 
that all types of errors did not receive equal attention. To 
quote this sections "Teachers were careful to mark every error 
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in mechanics, sentence structure, and usage and to write de- 

7 

tailed comments on general effectiveness," It is possible that 
in the intensive evaluation group, the emphasis was heavily on 
errors in form and mechanics to the possible neglect of short- 
comings in content. It is not at all clear whether this emphasis 
was also present in the comment treatments of the moderate eval- 
uation group. If not, the emphasis on form would have been a 
concealed, and possibly significant, independent variable. 

Furthermore, the intensive evaluation treatment Involved 
not only the number and kind of comments written on each paper, 
but also the additional variable of revision and rewriting. 
Students undergoing intensive evaluation were expected to revise 
and rewrite their papers and occasionally did this work outside 
class. Students in moderate evaluation groups neither revised 
nor rewrote nor worked on assigned essays outside class. 

A researcher profiting from the mistakes of Burton and 
Arnold would clearly define his independent variables, being 
careful to identify and control such factors as revision and 
emphasis on form. 

Buxton (1958) 

In the work of Bari Buxton, as in that of Burton and 




Arnold, revision is tied to intensity of evaluation as a hidden 
variable. Experimental Group A received no grades and no mar- 
ginal comments; they were not required to revise their essays. 
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The papers of Experimental Group B, on the other hand, received 
both grades and marginal comments; these students also revised 
and discussed their papers in class time* 

Buxton, however, does take into account a variable 
totally ignored by Burton and Arnold: positive reinforcement* 
Both of Buxton 1 s experimental treatments Involved a paragraph 
of comment at the end of each paper. In Group A, the emphasis 
was on praise; each essay was praised as much as possible, and 
one or two ways in which the paper might be improved were pointed 
out. In Group B, no special effort at praise was made in the 
final paragraph of comment. 9 

It is worth noting that the number of instances of praise 
per paper was not controlled. Tight control of the independent 
variable of positive reinforcement would be a wise precaution 
for future experimenters. 

Page (1958) 

Positive reinforcement is treated in a similarly unsys- 
tematic way in the classic study by Ellis Page. Page used two 
experimental groups: a specified comment group and a free oomment 
group. All his specified comments were designed to be encour- 
aging; no similar restriction was placed on the free comments. 

The presence of either type of comment resulted in statistically 
significant improvements in objective test scores. Interestingly 
enough, there was no significant difference between the test 
performance of students in the two experimental groups.^ 



One 
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might expect students to respond even more favorably to indi- 
vidual comments than to generalized ones; on the other hand, 
some free comments might have been less encouraging than the 
specified ones, 

Furthermore, there is no indication that the free comments 
were comparable in length with the specified comments, which were 
about four or five words apiece, A free comment could be ^what- 
ever comment the teacher might feel it desirable to make, M ^ 
Teachers were instructed: M Write anything that occurs to you in 
the circumstances. There is not any 1 right 1 or r wrong r comment 
for this study, 

If students equate length of comment with negativity of 
comment, comment length should be considered, in the future, as 
an important independent variable. In addition, positive and 
negative reinforcement should be controlled for both free and 
specified comments. 

Sweet (1966) 

In a study heavily indebted to Page, Roger Sweet studies 
the effect of written teacher comments on both student perfor- 
mance and student attitude. As might be expected, Sweet has the 
same possible sources of error as Page: he controls neither rein- 
forcement nor length of comment, 

like Page, Sweet is concerned with the effects of oom- 

13 

ments written on tests "not of the long essay type,” not 
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student compositions* Like Page, he used two experimental groups, 

a specified comment group and a free comment group. Unlike 

Page, however, Sweet distinguishes between short-term and long-run 

results. Since Page does not specify even the average time lapse 

between the two objective tests in his study, It is impossible 

to compare his results with Sweet* s* Sweet concludes that both 

free and specified comments had little if any short-term effect 

on test performance. Over a longer period of time, however, 

free comments significantly improved both performance and 
14 

attitudes. 

Sweet is concerned with attitude toward English class in 
general, not toward written comments in particular. His instru- 
ment is an inventory based on C. E. Osgood* s semantic differential. 
All twenty-one items in this inventory are school-related activ- 
ities; only six, however, are related to the English classroom 
in particular. Six questions provide scanty evidence on which 
to base conclusions. Furthermore, the items pertaining to the 
English classroom are: class discussions, oral reports, reading 
assignments, written assignments, library books, and length of 
the class period. 1 ^ None of the English items measures attitude 
toward written English tests. This is a serious omission, since 
comments written on tests could be most reasonably expected to 
effect attitude toward tests. 

Sweet’s experience suggests the experimenter beware of 



inadequate instruments. His results also indicate that the 
distinction between short-term and long-run can be very fruitful, 
Taylor and Hoedt (1966) 

Taylor and Hoedt examine, more systematically than any 
other experimenters, the variables of positive and negative 
reinforcement. The papers of Experimental Group A were praised 
regardless of actual merit; the best parts were circled in red; 
all errors were overlooked. Group B received heavy negative 
reinforcement; the errors on their papers were circled, and 
the best parts were overlooked. 

Attitude in this study was assessed by a rather unsys- 
tematic variety of measures, including an attitude check list, 
anecdotal records of overt behavior, and the number of vrrlnkled 

torn papers (the assumption here is that such papers are an in- 

1 6 

dication of anger and frustration). Like that of Sweet, Tay- 
lor and Hoedt r s study points to the difficulty of perfecting a 
good instrument for measuring attitudes. 

HI STATEMENT OF THE PROBLEM 

This study focuses on two independent variables Implicit — 
if frequently neither stated nor clearly defined— in the existing 
research: number and sign of written teacher comments. The aim 
is to determine the effects of various combinations of reinforce- 
m4mt upon three dependent variables: student perception of comments 
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as positive or negative, student satisfaction with comments, and 
student confidence in writing ability. Having done this, one 
can tentatively conclude which of a number of comment treatments 
are most Conducive to student satisfaction and confidence. Be- 
cause of the Involved nature of the treatment groups, discussion 
of the hypotheses will be deferred until the necessary ground- 
work has been laid. 



IV CONCEPTUALIZATION 



Given the dearth of research, there can be no rigid model 
of how students react to the messages scribbled on their themes. 
One can safely assume, however, that this reaction is a composite. 
It seems best to begin, then, with a sketch of steps which might 
possibly contribute to the final reaction: 



Step 1 . Student decision on whether or not he understands 
the teacher* s comments. 

Step 2. Student interpretation of comments as primarily 
positive or primarily negative reinforcement. 

Step 3. Student evaluation of the teacher as a reader of 
his paper : does the teacher understand the paper? 

Step 4. Student evaluation of the teacher as a writer of 
comments: do the teacher *s comments reflect biases along 
the dimensions of 

a. content/expression? 

b. positive/negative reinforcement? 

c. number of comments? 

Step 5. Student decision to accept or reject the teacher’s 
biases. 




Step 6. Student decision to agree or disagree with most 
of the comments written on his paper. 

Step 7. Maintenance or adjustment by the student of his ' 
belief in the worth of his paper. 

Step 8. Maintenance or adjustment by the student of his 
belief in his general writing ability. 



One can reduce this scheme, with its eight sequential 
steps, to three distinct yet interrelated factors: 



1 . Student interpretation of comments as either positive 
or negative reinforcement. (Step 2.) 

2. Student satisfaction with the comments. (Steps 1, 3, 
4, 5, & 6; the student is assumed satisfied if he under- 
stands the comments and if his biases and judgments agree 
with those of the teacher.) 

3. The effect of the comments on the student's confidence 
in his writing. (Steps 7 & 8.) 



Factors 1 , 2, and 3 were the basis for the construction 
of the experiment's attitude questionnaire. Note that while 
Factor 1 and Factor 2 are related, they are conceptually dis- 
tinct. If, for whatever reason, the student is sufficiently 
dependent upon his teacher's judgment, the most negative of 
comments will in no way affect his "satisfaction" with what the 

teacher has written. Conversely, if the student has a high N 

Ach 

and relatively low dependence, extensive negative reinforcement 
may lead to a general, and possibly ungrounded, dissatisfaction 
with the comments. Similarly, for those students with an 

Inflated idea of their own abilities, negative reinforcement 



may have little effect on their own estimation of their writing. 



V RESEARCH DESIGN 



Independent Variables 

The two independent variables are number and sign of 
written teacher comments. These two elements were selected 
because of contemporary educational practice. Current thought 
equates adequacy of written evaluation with extensiveness of 
comment; the better the teacher, the more detailed the comment. 
On all except the very best papers, comments more often take 
the form of corrections than words of praise. Therefore, the 
more extensive the comment, the more numerous the instances 
of negative reinforcement. 

Students, unlike educators, may interpret detailed com- 
ments as condemnations of their compositions, rather than as 
indicators of teacher concern. Such an interpretation may cause 
dissatisfaction with the comments and, at the extreme, complete 

s 

rejection of them as meaningful statements. More importantly, 
detailed comments may be interpreted by the student to mean 
that his writing is a dismal failure and will always be so, 

Jew of us elect to do those things at which we are destined to 
fall. The Importance of discovering exactly how students do 
interpret lengthy and/or negative comments is obvious. 
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Dependent Variables 

The dependent variables are the three factors outlined 
under Conceptualization 11 : student interpretation of the comments 
as either positive or negative reinforcement; student satisfaction 
with the comments; and student confidence in his writing. 



Research Design 

The research design sets up eight Experimental groups 
and one control group: 



In st * n ces of ftsnwe Reinforcement 
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Explanation of Treatment groups 

Group 0 : zero instances of negative and positive rein- 
forcement, The results of this group will he compared with data 
from the other groups to discover pretreatment levels of the 
independent variables. 

Group j two or three instances of negative reinforce- 
ment per page. 

Group four or five instances of negative reinforcement 
per page. 

Group P f : two or three instances of positive reinforce- 
ment per page. 

Group P ni four or five instances of positive rein- 
forcement per page. 

Each N or P group measures the effect of one level of 
positive or negative reinforcement. It would be impossible to 
measure any interaction effects if the effect of each level of 
each type of reinforcement were unknown. 

Group : two or three Instances each of positive and 
negative reinforcement per page. 

Group X o: two or three instances of positive reinforce- 
ment and four or five instances of negative reinforcement per 
page. 

Group 3U : four or five Instances of positive reinforce- 
ment and two or three instances of negative reinforcement per 
page. 
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Group X^ : four or five instances each of positive and 
negative reinforcement. 

Ih all cases, an instance of positive or negative rein- 
forcement is defined as one negative or positive free comment 
written in the margin of the student* s paper. It was decided to 
use free comments in order to approximate actual class situations. 

VI SAMPLE 

The sample consisted of 141 eleventh grade students in 
six English classes. All subjects were drawn from a four year 
high school in an upper-middle to middle-middle class suburb of 
Chicago. There were four ability tracks at the school: Basic, 
Intermediate, Advanced, and Honors; subjects were taken only 
from the two middle tracks. Of the total number of subjects, 

50 were enrolled in Intermediate English III and 91 in Advanced 
English III. All subjects were the students of one of two young 
female teachers. Each English teacher taught three classes. 

VII METHODOLOGY 



Treatment Groups 

Treatment groups were formed by random stratified dis- 
tribution. Each student was first ranked within his teacher* s 
Advanced or Intermediate classes according to his most recent 



quarterly grade in English, He was then randomly assigned to a 
group. 

The Writing Assignment 

Oh May 1, 1969, the cooperating teachers distributed 
instruction sheets for an argumentative essay due four days later. 
(See Appendix 1.) Mo additional directions for the assignment 
were given.. All students wrote on the same topic in the same 
mode of discourse. 

The assignment was designed to discourage purely or highly 
affective themes— and, in fact, none were submitted. This control 
was important since the affective content of a student* s paper 
may influence his attitude toward comment treatments. 

Writing Conditions 

The writing conditions were as natural as possible. Since 
compositions were usually written outside class, students wrote 
their argumentative essays at home, free from imposed time limi- 
tations, This was an important experimental condition. If stu- 
dents are to write papers indicative of their abilities, they 
need time. In his "Suggested Methods of Research,” Richard 
Braddock suggests that if high school students are not given 
a seventy to ninety minute writing period, "their sentence 
structure and mechanics will be produced under artificial 
circumstances.**^ In such situations, students might reject 
teachers r comments as totally irrelevant to their usual writing 

performance. 
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Comment Treatments 

1 * 

Bach paper received one of the nine comment treatments. 
Since the experiment was designed to measure student reactions 
to comments only, no letter grade appeared on any paper. All 
comments were composed by the experimenter, but to normalize 
conditions, each teacher copied the comments onto the papers of 
her own students. 

Administering the Questionnaire 

Papers were returned during a regular class period. Ac 
soon as students received their essays, they were directed as 
follows : 

For the next five minutes, look over whatever comments 
happen to be on your papers. It will be important for 
you to be familiar with them. Your grades are not on 
your papers,- but they are recorded in my grade book. I 
will tell you your grades later in the period. 

Five minutes later, the essays were collected; students 
could not reread the comments while answering the questionnaires. 
If the students had kept their papers, their responses might 
have indicated more objectivity than they actually felt. Our 
purpose was to use the questionnaire as a measuring instrument, 
not as a study guide for the comments* 

1 8 

After the papers were collected, the questionnaires 
(see Appendix 2) were distributed, and each teacher read aloud 
the explanatory first page to her class. Students were then 
free to respond to the questionnaire at their own speeds. 
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Statistical Analysis 

19 

After assigning a number to every possible answer, 

we calculated the arithmetic mean of each group’s response to 

each question (*ip. Using 3^ and the estimated variance 

(pooled) of all combinations of two means, we determined the 

20 

significant differences among groups for each question, A 
standard one-tail T-test measured significance at the ,05 level, 
(See Appendix 3.) 

Reinforcement, Satisfaction, and Confidence Scores 

The next step was to discover the relative effects of 
the comment treatments upon the dependent variables. Inspec- 
tion of I. . shows that some comment treatments caused responses 
1 3 

which are significantly high or low relative to others. The 
following Relativity Scale quantitizes these differences: 



A score of six : a response significantly higher than all 
others , 

A score of five : a response significantly higher than some 
but similar to others, 

A score of four s a response significantly higher and lower 
than some but similar to others. 

A score of three : a response similar to all others, 

A score of two : a response significantly lower than some 
but similar to others, 

A score of one:: a response significantly lower than all others. 




The raw group scores for relative satisfaction, confidence. 



and positive reinforcement were found by summing group scores 
for the appropriate questions, 21 To discover the changes 
caused by the experimental comment treatments, we subtracted the 
relevant Group 0 score from each of the twenty-four composite 
experimental group scores, (Remember that the scores of Group 0 
indicate pretreatment levels of the dependent variables.) These 
adjusted scores were the final measures of Satisfaction (S), 
Confidence (0), and Reinforcement (R) . 

VIII HYPOTHESES 

If students have been so conditioned by grading pro- 
cedures that they blindly equate detailed response with negative 
response, Group X^ (the group with the highest number of total 
comments) will score consistently lower than all other groups; 

X 2 and X^ will score the second lowest; Xj, P 2 * and *2 wil1 
score second highest; and P-j and Iff will score highest. 

If each score of each mixed treatment group (X^ , Xg, 

Hy and X^) is not equal to the sum of the scores of that 
group^s components, then there is interaction between the in- 
stances of positive and negative reinforcement in that group* 
Briefly, the purpose of the experiment Is to disprove 
the following null hypotheses: 
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1 • There is no difference between pretreatment and post treat- 
ment levels of S, 0, and H. 

0 s a No = P 1 = P 2 = X 1 s X 2 = X 3 r X 4 



2, There is no difference in the effect of positive and nega- 
tive reinforcement on S, 0, and R, 

*1 = p 1 K 2 = P 2 



3* There is no difference in the effect of different amounts 
of positive reinforcement on S, 0, and R. 



4. There is no difference in the effect of different amounts 
of negative reinforcement on S, 0, and R. 

■l » H 2 

5* There is no interaction between positive and negative rein- 
forcement, 

X 1 = N 1 4 P 1 ; X 2 = ff 2 4 Pi ; X 3 s r t 4 P 2 ; X 4 = R 2 4 P 2 



IX RESULTS 

Omitted Questions 

Since group responses to neither question four nor 
question six differed significantly, these questions were 
omitted in the final scoring. Question four measured students 1 
confidence in the quality of their next paper; question six 
measured opinions on the relative importance of form and con- 
tent to good writing. Of 141 students, 65 said they would be 




" somewhat pleased with the quality of their next paper; 30, 
"very pleased* 1 ; and 25* "neither pleased nor displeased, 11 Only 
10 said they would he "somewhat displeased"; only 2, "very 
displeased." The 9 remaining students left the question blank. 
Of 141 students, 99 thought form and content equally important; 
33 favored content over form; 9 favored form over content. 
Humber of Comments: Amount of Praise; Amount of Criticism 

How did students respond to those questions which 
directly measured their reactions to the independent variables? 

The mean response (3.0) of treatment group was 
equivalent to the optimal response, "just enough comments.” 
Group H^s response was significantly closer to this optimum 
than that of groups Pg* and response was similar, 

however, to that of all other groups. Comment treatments X^ 
and H 2 were considered to contain significantly more than the 
optimum number of comments; treatment Pg* significantly fewer. 

No comment treatment contained significantly more than 
the optimal amount of criticism; treatments P^, Pg, X^, 
however, all contained significantly less. Group X3 (mean 
response of 3.0) was significantly closer to this optimum 
than Pg, P*j , and Xj ; the response of all other groups was 
similar to that of X3. 

The mean response (3*0) of treatment group X^ was 
equivalent to the optimal response, "just enough praise. 
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Treatments and N^, contained less than the optimal amount 
or praise; treatments p£ and P^ , significantly more. All other 
groups could not be said to contain significantly more or less 
than ’’just enough, praise.” 

Reinforcement. Satisfaction, and Confidence Scores 

All Reinforcement, Satisfaction, and Confidence scores 
are reported below. In no case will differences of 41 or -1 
he considered as meaningful. 





0 


?, 


6 


K 




Y, 


Yi 


y 3 


Y* 


R 


o 


o 


a 


-A 


-a 


-a 


"*<2 


O 


-a 


C 


0 


7 


to 


-/ 


o 


/ 




to 


£ 


S 


0 


7 


7 


3 


-a 




3 


n 


/ 



X CONCLUSIONS 



Pretreatment Conditions 

If nothing else, this study indicates that ’’fear 
and disgust” still are rampant in the English classroom. It 
is rather sobering to realize that the Satisfaction score for 
Group 0 was lower than that of any other group hut Group N . 

to 

The Confidence score for Group 0 was lower than that of 



four experimental groups; It was higher than none. There 
is one bright spot, however: most students seem to recover, 
at least partially, from the crushing effects of written 
teacher comments. After all, more than two-thirds thought 
they would be either "somewhat pleased" or "very pleased" 
with the results of their next paper. 
go rm vs Content 

The neglect of content emphasized so heavily by Lyman 
and Hayakawa does not seem a relevant factor for the classes 
in this sample. As mentioned earlier, most students thought 
form and content equally important to good writing. Further- 
more, only 21 out of 138 thought their teachers valued form 
more than content. Of the rest, all but 7 felt their teachers 
considered form and content equally important. If there was 
not an undue emphasis on form, what did cause dissatisfaction 
with written teacher comments? Or, to turn the question 
around, what sort of comment treatments lead to the highest 
satisfaction? 

Number of Comments 

Sheer number of comments does not determine how a 
comment treatment will be received. Neither H, 0, nor S was 
dependent upon number of comments. Those treatment groups 
with the fewest comments— , Nj , , Pg, and Ng— did not 

produce the highest R f s, 0*s, or S*s. 



Nor did those treatment 
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groups with the most comments — X^, X 2 , and X^ — score 
correspondingly low* 

Experimental conditions required students to study 
their comments attentively. This suggests, at the very least, 
that when students are forced to read the comments on their 
papers, they are not biased by number* 

Positive and Negative Reinforcement 

The results showed that there was a difference in 
effect between positive and negative reinforcement. The 
purely negative comment treatments, and generally 
produced scores lower than the initial (pretreatment) R, C, 
and S. As might be expected, the purely positive treatments, 

Pj and P 2 , generally produced scores higher than those of 
Group 0, There were only t^ree exceptions to this patterns 
treatment Ej caused an increase in S; treatment U 2 C£ wsed 
no change in C; treatment caused no change in R. 

Levels of Positive Reinforcement 

In two instances out of three. Group Pg scored higher 
than Group P^, In the case of S, however, scores for Group Pj 
and Group P 2 were equivalent* Higher levels of purely positive 
reinforcement produced scores equal to, or higher than, those 
caused by lower levels. 
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Levels of Negative Reinforcement 

In the case of R and C, the scores of Group and 
Group N 2 were equivalent. The S of Group Kj , however, was 
larger by five than the S of Group ff 2 . This is a large 
difference in a total range of thirteen points. It is 
important to remember here that R and 0 together are a com- 
posite of only five questions, while S is a composite of 
eight* Ifc this light, it seems reasonable to consider the 
difference between S f s an important one. Whereas Treatment 
N 1 raised S from the pretreatment level, Treatment N 2 decreased 
it, by roughly the same amount. This suggests that once 
criticism exceeds what is perceived as a "normal 11 level, 
satisfaction with the comments will decrease. Presumably, 
the S measure, with its multiple questions, caught a difference 
undetected by the single question (# 13 ) which measured response 
to the amount of criticism. As noted earlier, no comment 
treatment contained more than the optimal amount of criticism— 
although both IST^ and U 2 contained less than the optimal 
amount of praise. Perhaps students perceive negative loading 

of comments as "too little praise," not "too much criticism." 
Interaction Effects 

Of the four mixed treatment groups, only Group X 3 
showed no evidence of interaction between instances of pos- 
itive and negative reinforcement. In the cases of X-j , X 2 , 



and X^, there were large differences between the score of 
the X group and the combined scores of its components. The 
only two exceptions to this pattern were the R f s for Group 
and Group X^. This deviation may be explained by the 
severely limited range ( /2/ ) between the R r s of Group N 1 , 
Group P-j , and Group P 2 « It seems safe to conclude that 
interaction exists in all mixed groups except Group X^. 

What 1 is the significance of the lack of interaction 
in the case of Group X^? One of the components of Group X 3 
is which is consistently a very high scorer. Group 
Xr, ‘would have had to score high indeed to surpass the 
combined score of its components. Those who think praise a 
panacea should find it remarkable that a treatment containing 
negative reinforcement produced scores as high as those of 
the heavily positive treatment P 2 . Remember: treatment P 2 
was considered to contain more than the optimal amount of 
praise and less than the optimal amount of criticism. There 
is such a thing as ’’too much praise” and ”too little criticism. 
Recommendations 

Careful balancing of negative comments with positive 
is not an adequate solution to the problem of fear and 
disgust.” The' 0 of Group is in the lower half of all 
Confidence scores, while the S of Group X^ is in the lower 
half of all S r s. Students reacted with the greatest 
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confidence and the most satisfaction to treatments x 3» p 1* 
and Pg* These were the same groups which they perceived as 
relatively positive— and which were, in fact, positively 
loaded. 

The implications seem clear. An occasional positive 
comment is not enough. Teachers should he sure they find 
more to praise than to criticize. We do not suggest that 
all criticism be omitted. In fact, the indications are that 
criticism, well tempered with praise, produces the most 
satisfied and confident wr iters of all. 



APPENDIX 1 : THE WRITING ASSIGNMENT 
The Results of Violence on Television 

Violence on television Is the cause of increased 
violence today in the streets and on college campuses. The 
average evening T.V. show Is a class in crime: blackmail, 
murder, robbery, riots, and drugs. Young people often get 
into trouble merely for copying behavior which adults allow 
to be shown on the screen. Children grow up glued to the T.V. 
set, learning as they watch that violent action is the answer 
to their problem— whether the problem is poverty, discrimination, 
neglect, or simple boredom. Even the evening news broadcast 
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features only blood and gore. The situation has grown so 
bad that there now remains just one solution. We, as parents, 
must totally refuse to allow our children to watch television. 
At the worst, our youngsters will read more good hooks and 
play more baseball. XT they get bored, they can always gather 
around the radio. After all, that's what we did when we were 
young, and we*re still a pretty peaceful bunch, aren't we? 

Vrite a well-organized, well-supported essay in which 
you comment on this paragraph. You may find the following 
questions helpful: 

To what extent do you agree or disagree with this 
statement? Remember that this statement has many 
parts; consider each one of them carefully. Support 
your stand with examples . Be sure to refer to 
specific events and/or specific T.V« programs. 

Is this writer objective or biased? Point out 
specific words or phrases which support your answer. 
What sort of person would be likely to agree with 
this man? Tb disagree with him? Why? 




APPENDIX 2: QUESTIONNAIRES , VERSIONS A AND B 



Explanatory Page Attached to Questionnaire. Versions A and B 

The following questionnaire is part of a study de- 
signed to find out what students think if the comments which 
teachers write on their compositions. We want to know what 
you think. 

Please be completely honest in your response. Your 
answers will be entirely anonymous; there is no way of telling 
which questionnaire belongs to which student. What you say 
cannot possibly get you (or your teacher) into trouble. 



Remember: you are playing an important part in a piece 
• of educational research. Your opinions can help teachers 
teach you better. 

Questionnaire Version A, Administered to group 0 

1, On the basis of the comments usually written on my English 
papers, I think my teacher would agree that: 

a. My English papers are very poor. 

b. Despite some serious errors, my English papers have 
their good points, 

c. There is nothing either particularly good or particularly 
bad about my English papers. 

d. Despite some minor errors, my English papers have their 
good points. 

e. My English papers are very good. 
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2. I feel that I usually understand! 

a* all of the comments written on my English papers. 
h # most of the comments written on my English papers. 

c. some of the comments written on my English papers, 

d. few of the comments written on my English papers. 

e. none of the comments written on my English papers. 



3. I usually agree with: 

a. none of the comments written on my English papers. 

b. few of the comments written on my English papers. 

c. some of the comments written on my English papers. 

d. most of the comments written on my English papers. 

e. all of the comments written on my English papers. 

4. X personally would agree with the following statement: 

a. ”It r s not what you say — it r s how you say it.” 

b. ”What a person has to say is more important than how 
he says it.” 

c. ”In good writing, what a person says and how he says 
it are equally important.” 



5. I usually feel that: 

a. all of the mistakes in my English papers are minor. 

b. most of the mistakes in my English papers are minor, 
e, some of the mistakes in my English papers are minor* 

d. few of the mistakes in my English papers are minor* 

e. none of the mistakes in my English papers are minor. 



6. I feel that when I finish writing my next English paper, I 
will be: 

a. very displeased with its quality. 

b. somewhat displeased with its quality. 

c. neither pleased nor displeased with its quallty e 

d. somewhat pleased with its quality, 

e. very pleased with its quality. - 
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7* I feel that I write: 

a. much better than most of the students In my class. 

b. a little better than most of the students in my class. 

c. as well as most of the students in my class. 

d. a little worst than most of the students in my class, 
t. much worse than most of the students in my class. 



8. The following statement applies to the number of comments 
usually written on my English papers: 

a. there are far too many comments. 

b. there are too many comments. 

c. thez»e art just enough comments. 

d. there are too few comments. 

e. there are far too few comments. 



9. Usually, after reading the comments on one of my English 
papers, I personally think that the paper: 

a. is very poor. 

b. despite some serious errors, has its good points. 

c. is neither particularly good nor particularly bad, 

d. despite some minor errors, has its good points. 

e. is very good. 



10. I feel that the amount of praise usually contained in 
the comments on my paper: 

a. is far too little. 

b. is too little. 

c. Is just enough. 

d. is too much. 

e. is far too much. 



11. I usually ft el that:- 

a, all of the mistakes in my EnglisE papers are major. 

b, most of the mistakes in my English papers are major. 

c, some of the mistakes in my English papers are major* 

d, few of the mistakes in my English papers are major* 

e, none of the mistakes in my English papers are major. 



o 
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12. Judging from the comments written on my English papers, 
my teacher usually understands my papers: 

a. completely* 
h. almost completely. 

c. somewhat. 

d. not at all. 



13. I feel that the amount of criticism usually contained in 
the comments on my English papers: 

a. is far too much. 

b. is too much. 

c. is just enough. 

d. is too little. 

e. is far too little. 



14. Judging from the comments usually written on my English 
papers, my teacher would most agree with the following 
statement: 

a. w It , s not what you say — it*s how you say it.” 

b. “What a person has 1 to say is more important than 
how he says it.“ 

c. “In good writing, what a person says and how he says 
it are equally important.’ 1 



Questionnaire Version B. Administered to Experimental Groups 



1 . On the basis of the comments written on my paper, I think 
my teacher would agree that: 

a. This paper is very poor. 

b. Despite some serious errors, this paper has its good 
points. 

c. There is nothing either particularly good or particu- 
larly bad about this paper. 

d. Despite some minor errors, this paper has its good 
points. 

e. This paper is very good, 

'V s * 



